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Abstract 


A  discrete  time  multiaccess  channel  is  considered  where  the 
outcome  of  a  transmission  is  either  "idle",  ^success""  or 
"collision*,  depending  on  the  number  of  users  transmitting 
simultaneously.  Messages  involved  in  a  -"collision*'  must  be 
retransmitted.  An  efficient  access  allocation  policy  is  developed 
for  the  case  where  infinitely  many  sources  generate  traffic  in  a 
Poisson  manner  and  can  all  observe  the  outcomes  of  the  previous 
transmissions.  Its  rate  of  successs  is  0.48776.  Modifications 
are  presented  for  the  cases  where  the  transmission  times  depend 
on  the  transmission  outcomes  and  where  observations  are  noisy. 
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I.  Introduction 

We  consider  the  following  model  of  a  multiple  access 
channel.  A  large  number  of  sources  generate  messages  in  a 
Poisson  manner,  at  a  total  rate  ofyX  messages  per  unit  of  time, 
starting  at  time  0.  Once  a  message  has  been  generated,  its 
source  can  transmit  it  on  a  common  channel.  Transmissions  can 
only  start  at  integer  multiples  of  the  unit  of  time  and  last  one 
unit  of  time,  also  called  a  "slot".  If  the  transmissions  from 
two  or  more  sources  overlap,  a  collision  is  said  to  occur,  all 
messages  are  lost  and  must  be  retransmitted  at  a  later  time.  If 
only  one  source  transmits,  the  transmission  is  successful. 

All  sources  can  observe  the  channel  and  learn  at  the  end  of 


a  slot  whether  it  is  idle,  or  if  a  success  or  a  collision  has 
occured.  This  common  feedback  is  the  only  information  the 
sources  share.  The  problem  is  to  find  an  effective  way  of  using 
the  feedback  to  schedule  the  transmission  of  the  messages. 

The  previous  model  is  an  idealization  of  practical 
communication  systems  [1],  [2],  [3]  that  have  been  the  object  of 
numerous  papers  in  the  communication  theory  literature  [4], [53. 
Similar  problems  have  also  been  treated  in  control  theory 
journals  [6], [7], [8],  indeed  they  are  nice  examples  of 
distributed  control.  Algorithms  similar  to  the  ones  presented 
here  have  also  been  derived  independently  by  Tsybakov  and 
Mikhailov  [9]. 

In  Section  II  we  will  present  the  basic  algorithm  and  some 
of  its  properties.  In  Section  III  we  show  how  to  analyze  the 
algorithm  in  order  to  optimize  the  throughput,  i.e.,  the  maximum 
long  term  rate  of  success.  In  Section  IV  we  discuss  the 
implementation  of  the  algorithm  in  real  time.  In  Section  V  we 
introduce  the  general  form  of  a  first  come  first  served 
algorithm.  We  then  show  how  to  modify  and  analyze  the  algorithm 
if  the  transmission  times  depend  on  the  transmission  outcomes 
(Section  VI)  or  if  the  feedback  is  noisy  (Section  VII). 


II.  The  Basic  Algorithm 


« 


The  algorithm  defined  below  allows  the  transmission  of  the 
messages  on  the  basis  of  their  generation  times.  It  has  the 
advantage  of  being  effective  no  matter  the  number  of  sources, 
even  infinite,  and  is  a  generalization  of  the  procedure  presented 
in  [10],  which  is  itself  based  on  an  idea  from  Hayes  [11 J  and 
Capetanakis  [12].  This  idea  had  been  used  previously  for  other 
applications  as  described  in  [ 1 3  J . 

We  abstract  the  problem  as  follows:  messages  are  generated 
according  to  a  Poisson  point  process  with  rate  \  on  R+=[0,<=0). 
At  each  step,  the  algorithm  designates  a  subset  of  the  half-line, 
and  messages  generated  in  that  subset  are  transmitted.  This 
transmission  subset  is  chosen  as  a  fuction  oi  the  history  of  the 
outcomes  of  all  previous  transmissions.  The  process  is  repeated 
ad  infinitum.  The  rate  at  which  successes  are  produced  is  called 
the  "throughput"  of  the  algorithm. 

In  our  algorithm,  the  set  of  messages  that  are  transmitted 
during  the  nth  time  unit  interval  are  those  generated  in  a  time 
interval  of  the  form  [a,b).  This  interval  will  be  referred  to  as 
the  "transmission  interval".  At  each  step  of  the  algorithm,  we 
update  three  parameters,  yR,  sn,  and  tR,  which  characterize  the 
state  of  the  algorithm.  These  parameters  are  used  to  calculate  a 
and  b,  the  endpoints  of  the  transmission  interval.  Specifically, 
the  transmission  interval  is  given  by  [a,b)  =  [yn,yn  + 
F(sn,tn))f  where  F  is  a  given  function  to  be  optimized  below.  F 
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has  the  properties  that  it  maps  R+|/{oo)  x  R+Ufo^)  into  R+  and 
F(s, t)  <  t. 


The  values  of  yQ ,  Sq,  and  tQ  are  initially  equal 
respectively  to  0,c?O  and  oo  ,  and  the  yn*s,  sn’s  and  tn's  (sn-£tn) 
are  updated  by  the  following  rule,  where  Fn  =  F(sn,tn). 


If  a  transmission  results  in 


idle : 


collision: 


rn+1 


+  Fr 


sn+1^"sn  *  Fn 

t  , t  -  F 
n+1  n  n 


success:  yn+l*-*n  +  Fn 


sn+1^fcn  ~  Fn 
tn+1  00 

yn+i^y. 


n 


l^mir,(Sn»  Fn  ^ 

n+l^^n 


As  an  example  of  how  this  algorithm  works,  consider  Figure 
1.  Here  F  (00  ,0©  )  =  ^  where  Z?  is  some  finite  constant, 
F(s,oo)=s  and  F(s,s)=s/2  when  s  is  finite.  With  the  initial 
conditions  for  y,s  and  t  given  above  it  is  easy  to  verify  that 
for  this  F,  the  pair  of  parameters  (s,t)  will  always  be  one  of 
these  three  forms  (i.e.  (00,00),  (s,©o)  or  (s,s)).  This  is 
Gallager's  binary  splitting  algorithm  [10]. 


In  Fig.  I.a,  the  time  line  is  divided  into  unit  intervals 


4 


and  observation  of  the  process  begins  at  a  time  n,  such  that 
sn=tn=o^.  The  numbers  written  above  each  slot  indicate  the 
transmission  outcomes  for  that  slot:  0  represents  an  idle,  1  a 
successful  transmission,  and  12  a  collision.  Figs.  I.b-h  show 
the  sample  process  of  message  generation  times  that  gives  rise  to 
the  transmission  outcome  sequence  of  Fig.  I.a,  together  with  the 
sequence  of  transmission  intervals  selected  by  the  algorithm.  In 
the  nth  slot,  there  is  a  success,  and  the  algorithm  moves  the 
transmission  interval  forward  as  shown.  In  the  (n+1)st  slot 
there  is  a  collision,  and  so  the  transmission  interval  is  split 
in  half  and  the  first  half  tested  for  messages.  Because  there  is 
an  idle  in  slot  n+2,  this  implies  that  the  colliding  messages 
were  both  generated  in  the  second  half  of  the  (n+1)st 
transmission  interval.  Hence,  in  slot  n+3,  it  is  desirable  to 
examine  only  the  third  quarter  of  that  interval.  Since  another 
collision  occurs,  this  interval  is  split  in  two  and  the  first 
half  tested,  yielding  a  success  in  slot  n+4.  Now  it  is  known 
that  the  second  half  of  the  transmission  interval  for  slot  n+3 
contains  at  least  one  message.  Using  it  as  the  transmission 
interval  for  slot  n+5  produces  another  success.  At  this  time  it 
can  be  observed  that  all  messages  generated  between  yn  and  Yn+5 
have  been  successfully  transmitted  and  all  conflicts  have  been 
resolved.  For  slot  n+6  the  algorithm  selects  the  transmission 
interval  of  length  as  shown. 

It  should  be  noted  that  the  algorithm  used  in  this  example 
is  a  special  case  of  the  algorithm  described  above,  and  the 
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choice  of  F  is  sub-optimal  with  respect  to  throughput.  It  is  not 
always  desirable  to  divide  a  transmission  interval  containing  a 
collision  exactly  in  half.  Also,  when  an  interval  is  known  to 
contain  at  least  one  message  generation  time,  there  exist 
conditions  such  that  that  interval  is  not  the  best  choice  for  the 
transmission  interval.  These  issues  are  discussed  in  section 
III. 

Returning  to  our  general  algorithm,  we  make  some  assertions 
about  the  message  generation  times.  Given  the  outcomes  of  the  n 
past  tranmissions,  we  know  that  all  messages  generated  in  [0,yn) 
have  been  successfully  transmitted.  To  see  this,  note  that  the 
monotonic  sequence  of  times  yQ,  y^ ,  .  .  .  yn  divides  the  interval 
[0 , y^ )  into  the  sequence  of  intervals  [y0,y.j>,  [y-|,y2^»  •  •  •  » 
[y„  1fy  ),  such  that  each  of  these  intervals  contains  exactly  0 
or  1  generation  time.  (Whenever  there  is  a  collision,  yn+i=yn 
and  the  "interval"  [yn,yn+.|)  is  empty.)  Hence  at  time  n,  all 
messages  generated  prior  to  yfi  must  have  been  successfully 
transmitted . 

It  can  also  be  shown  that,  given  the  outcomes  of  the  n  past 

transmissions,  the  generation  processes  in  [0,y  ),  tynfyn+tn^  and 

[yn+tn,00)  are  independent.  The  generation  times  in  tyn,yn+tn> 

are  distributed  according  to  a  Poisson  process  with  rate  \  , 

conditioned  on  the  facts  that  there  is  at  least  one  generation 

time  in  ty^,y„+t  ),  and  at  least  two  generation  times  in 
nnn 

ty„»y..+t.,)  •  The  generation  times  in  [y„+t  .°o)  are  distributed 
nnn  n  n 


according  to  a  Poisson  process  with  rate 


The  proof  of  these  facts  is  intuitively  straightforward  when 
each  possible  case  is  considered  separately.  For  example, 
consider  the  case  where  the  generation  times  in  A=[y  ,  y  +t  )  are 
Poisson  conditioned  on  A  containing  a  conflict  and  the  generation 
times  in  [yn+tn,o°)  are  known  to  be  Poisson.  Then,  if  the 
transmission  interval  [yn,yn+Fn)  is  found  to  contain  a  conflict, 
it  is  easy  to  show  that  the  generation  times  in 

^■yn+1  ,yn+1+tn+1  ^yn,yn+Fn^  are  p°isson  conditioned  on  that 
interval  containing  a  conflict.  Furthermore,  the  generation 
times  in  [ yn+1 +tR+1 ,°°) =[ yn+Fn *°°)  are  Poisson.  To  see  this,  note 

that  £yn+Fn»°°)  =  [yn+Fn,yn+tn^  ^yn+tn,po)  *  The  generation 
times  in  [yn+tn,°o)  were  asssumed  to  be  Poisson,  and  the 
generation  times  in  t yn+Fn , Yn+tn )  can  be  shown  to  be  Poisson  by 
the  following  argument.  We  use  "k  in  [x,y)"  as  an  abbreviation 
for  "the  event  that  there  are  k  generation  times  in  the  interval 
[x,y)n  and  "J>2  in  [x,y)"  as  an  abbreviation  for  "the  event  that 
there  are  at  least  2  generation  times  in  [x,y)."  Then, 


PrOc  In  [yn.Fn,yn*tn)!22  in  [yn, y„*Fn)  ,22  in  t 
=Pr(k  in  [yn.Fn,yn+tn),22  in  t y„, yn+Fn> ,22  in  ty„,  »„•*„>) 
/Pr(22  in  tyn, yn+Fn ) ,22  in  ty„.yn*tn>) 

=Pr(k  in  [yn.Fn,yn.tn),22  in  Iyn,yn*Fn>)/  Pr(22  in  [yn,y„*Fn>> 
.Pr(k  in  tyn*Fn,yn.tn)). 


Hence  [yn+^+tn+^ ,oo)  is  the  union  of  two  disjoint  intervals,  each 
of  which  contains  message  generation  times  distributed  according 
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to  independent  Poisson  processes. 

In  order  to  make  a  rigorous  statement  ot  these  assertions,  a 
few  definitions  are  needed.  Define:  An=^°*yn^’  Bns^yn*yn+Sn^ » 

Cn=tyn’VV»  Dn=[yn+tn»°°)  and  Tn=[  yn'yn+V  *  Let  N(S)  be  the 
number  of  generation  times  in  a  set  S.  Let 

d  n=  0  if  N(Tn)=0 

1  1  if  N(Tn)=1 

k2  if  N(Tn)i2 

Let0(n)  =  (  lf.  .  n)  and  for  convenience  define  (?(0)=$(-1  )=JZ* 
the  set  of  all  sample  processes.  (This  is  done  so  that  we  may 
condition  on  the  events  #(0)  and#(-1).)  If  we  have  an  n-vector 


of  sets 

s=(slf.  .  . 

any 

set  A, 

let  A 05  denote  the 

n-vector 

(An  s1 ,. 

.  .,AOSn) 

and 

let 

U(£) 

denote 

<  N( Sn )  ,. 

.  .,N(Sn)). 

We  may  now 

state 

the  following  : 

Theorem: 

For  any  integers  NA,  N 

C f 

choose 

measurable 

finite 

subsets 

AniCAn  for 

i=1 , .  .  . 

*  NA’ 

C  CC 
nj  n 

for  j=1 , .  . 

•  » 

Nr 

Dn  <~Dn  for  k=1»*  •  •»  nd*  Then  for  aRy  vectors  meZ  f  £*Z  , 


Pr  ( U(  An )  =1,  H( £n )  =fi ,  H(  £n )  =fl  1 0(  n- 1 ) ) 

=  Pr(li(An)=ffll&(n-l))Pr(2i(£n)=£iN(Bn)21,N(Cn)22) 
Pr(Ji(fin)=fl)  {1} 

for  all  n=0 , 1 , .  .  .  . 

The  proof  of  this  theorem  is  given  in  the  Appendix. 
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In  the  next  section  we  will  show  how  to  define  F ( — , — )  so  as 


to  maximize  the  rate  of  successful  transmission. 


III.  Analysis  and  Optimization 

The  key  to  the  analysis  of  the  algorithm  is  to  realize  that 
the  process  ^sn»tn^  *s  Markovian,  as  the  probabilities  of  the 
different  outcomes  of  the  (n+1)st  transmission  and  the  values  of 
(sn+1 ’tn+i )  dePend  only  on  sn  and  tn>  This  is  a  direct  result  of 
the  theorem  stated  above,  since  the  transmission  interval  TR  is  a 
subset  of  Cn< 

We  should  notice  the  peculiar  role  of  the  (Ck5,Qo)  state. 
Physicallly  it  corresponds  to  all  messages  generated  before  yn 
having  been  successfully  transmitted  and  no  information  except 
the  a  priori  statistics  being  available  about  generation  times 
greater  than  yn<  That  state  is  entered  every  time  two 
transmissions  result  in  a  success  without  an  intervening 
conflict.  Thus  it  is  reachable  from  all  other  states. 

Moreover,  if  F(-,~)  is  such  that  the  probability  of 
successful  transmission  in  any  state  (s,t)  has  positive  lower 
bound  (this  is  always  the  case  for  the  F(-,-)'s  considered 
below),  then  state  (OO,  s>o)  is  positive  recurrent  along  with  only 
countably  many  other  states  accessible  from  it.  Thus  the 
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computation  of  stationary  state  probabilities  and  expected 
values,  with  a  given  degree  of  precision,  is  a  straighforward 
numerical  matter. 


We  will  now  direct  our  attention  to  the  problem  of  selecting 

F(-,-)  to  maximize  the  long  term  rate  of  success,  i.e., 

lim  inf-M  ^  r(i)),  where  r(i)  is  equal  to  one  if  the  ith 
*  'c-o 

transmission  is  successful,  and  zero  otherwise. 


Throughout  the  analysis  that  follows,  the  parameters  s^t^ 
and  F  are  taken  to  be  normalized,  that  is,  the  units  in  which 
they  are  measured  are  chosen  such  that  the  generation  rate  of  the 
messages  is  1 . 


We  find  the  optimum  F ( — , — )  by  the  succesive  approximation 
method  of  solving  undiscounted  infinite  horizon  Markovian 
decision  theory  problems  [14].  That  is,  we  assume  that  the 
process  will  end  after  N  more  transmissions  and  assign  to  each 
state  a  value  equal  to  the  expected  reward  on  the  next  state 
transition  plu3  the  expected  value  of  the  subsequent  state.  That 
is, 

V(3,t)(n*1)= 

max  [Pr(a-n=Ols,t,Fn(s,t))v(s.p(  t)t.F(  ),(>!) 

Fn(s,t)^°  n  n 

+Pr(@n  =  1  Js,t,Fn(s,t)XUv(t_F  (s ,t),oo)(n)) 

+Pr(0n=2 is,t,Fn(s,t))v(min(s  r  (s>t)  -  (s>t))(n)] 
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with  V(s  t)(0)=0  for  all  s,t.  As  N  goes  to  infinity  the 
differences  v^s  t^(N+1)-v^g  t)^  converge  to  the  throughput  A* 
and  the  sequence  of  functions  FN(s,t)  converge  to  the  function 
F(s,t)  that  achieves  the  throughput  A*- 

The  value  functions  v^s  ^(N)  and  the  control  functions 
FN(s,t)  were  evaluated  numerically  for  a  finite  number  of  points 
over  an  appropriately  bounded,  discretized  state  space.  Details 
of  this  work  are  found  in  [153.  Several  interesting  conclusions 
were  reached. 

First,  the  optimal  F(s,t)  is  never  greater  than  s,  so  that 
all  states  (s,t)  with  s^t  or  t ioo  are  transient.  In  addition, 
although  a  threshold  s^  exists  such  that  for  s>sT,  F(s,t)<s,  if 
the  optimal  F  is  used  for  all  transmissions,  we  can  never  enter  a 
state  where  s  exceeds  this  threshold.  Hence,  for  all 
non-transient  states  we  have  F(s,t)=s. 

The  optimal  F(uo,>o)  iS  1  .275,  so  that  all  states  with 
°°>t>s>1 .275  are  transient. 

All  that  is  required  now  to  complete  the  specifications  of 
F <  — ,  — )  are  the  values  of  F(s,s)  for  0<s<1  .275.  These  are  given 
in  Table  1.  Observe  that  F(s,s)  is  approximately  s/2.  Hence, 
this  algorithm  is  very  close  to  the  binary  splitting  algorithm 
described  in  Section  II.  Indeed,  the  improvement  in  the 
throughput  of  this  algorithm  over  the  other  is  negligible: 
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0.48776  versus  0.48711.  The  binary  splitting  algorithm  would  be 
optimal  if  whenever  a  collision  occurred  the  collision  were  known 
to  involve  exactly  two  messages.  But  because  there  is  some 
probability  of  more  than  two  messages  colliding,  the  optimal 
F(s,s)  is  slightly  less  than  s/2. 

We  note,  however,  that  the  first  remark  above  (i.e.,  that 
the  optimal  F  satisfies  F(s,t)^s)  does  not  hold  for  finite 
horizon  (N<oe>)  problems.  For  these,  the  optimal  F(s,<*^)  may  be 
larger  than  s  for  small  N.  The  optimal  Fn(s,£*0)  is  shown  in 
Figure  2  for  N=3,  4  and  5.  We  note  that  for  each  N,  there  is  a 
large  discontinuity  in  F,  i.e.,  a  threshold  Sy(N)  such  that  for 
s<sT(N),  Fn(s,°o)>s  and  for  s>s.p(N),  FN(s,oo)=s.  The  threshold 
descreases  with  increasing  N,  becoming  smaller  than  the  grid  size 
(.01)  of  the  discretized  state  space  for  N>5.  No  similar 
behavior  was  observed  for  F(s,t),  t<°°,  probably  because  the 
numerical  optimization  did  not  consider  (transient)  states  in  the 
region  where  the  phenomenon  would  occur. 

The  existence  of  this  discontinuity  in  F  is  suprising  and 
the  reason  for  it  is  worth  discussing.  In  Figure  3  we  see  the 
value  functions  at  N=3  plotted  as  a  function  of  F  for  three 
states  in  the  neighborhood  of  the  threshold.  Each  of  these 
functions  have  two  local  maxima,  one  at  F=s  and  one  for  F>s.  For 
the  state  (,06,«>o)  the  maximum  occurs  at  F=.3.  For  (.07  po)  the 
two  maxima  are  equal.  For  (,08,°o),  the  maximum  is  at  F=.08. 
Hence  we  have  a  threshhold  at  s=.07. 
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As  mentioned  in  the  introduction,  a  similar  algorithm  has 
been  presented  independently  by  Tsybakov  and  Mikhailov  [93. 
Their  version  is  somewhat  more  restrictive  than  ours,  as  they 
impose  the  condition  that  F(s,^o)=s.  That  is,  when  an  interval 
is  known  to  contain  at  least  one  generation  time,  that  interval 
is  chosen  as  the  next  transmission  interval.  Hence,  the  only 
recurrent  states  have  the  form  (s,s),  (s,®o)  and  (o©,°"o),  exactly 
as  in  Gallager’s  binary  splitting  algorithm.  Thus,  only 
F(cx>,oo)=  ^  and  F(s,s)  for  s.C'C  need  to  be  determined.  They  do 
not  actually  find  the  optimal  F,  but  claim  that  if 
F(oz>,oo)=i  .275,  F(1  .275,1  .275)  =  . 584  and  F(s,s)=.485s  for  all 
s^.584,  then  the  throughput  is  .48778.  Using  the  same  values  for 
F(-,-),  we  calculate  a  throughput  of  .48773.  This  discrepancy  is 
unexplained,  but  since  the  results  differ  only  in  the  fifth 
decimal  place,  is  not  very  important. 

Note  that  the  optimal  algorithm  in  the  class  we  consider 
appears  to  lie  in  the  subclass  considered  in  [93. 

IV.  Real  Time  Implementation 

In  the  idealized  version  of  Section  III  it  was  assumed  that 
all  messages  were  generated  before  the  algorithm  started.  In 
practice,  generations  and  transmissions  would  take  place 
concurrently.  Hence,  the  original  algorithm  is  not  causal,  in 
the  sense  that  it  sometimes  specifies  that  messages  should  be 
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transmitted  before  having  been  generated.  This  can  be  remedied 
by  defining 

F_(s  ,t  .y  )=min[F(s  .t  ) , n-y  ]  {2} 
n  n  n  n  n’n  n 

The  quantity  n-yn  that  appears  above  we  call  the  lag  of  the 
algorithm.  That  is,  the  lag  is  length  of  time  during  which 
messages  have  already  been  generated  but  not  yet  successfully 
transmitted . 

To  analyze  real  time  performances ,  like  message  delay,  one 
must  study  the  Markov  process  (sn,tn,yn),  as  the  process  (sn,tn) 
is  no  longer  Markovian.  This  appears  to  be  extremely  complicated 
when  the  boundary  condition  {2}  is  imposed.  However,  some  simple 
statements  can  be  made  regarding  the  behavior  of  the  lag  n-yR  as 
a  function  of 

Let  k(m)  denote  the  time  when  (s,t)=(ot?,,CJ)  for  the  nth  time 
(that  is,  k(m)  =min  {k  |k>k(m-1 ) ,  (  s^,  tk)  =  (  ,  ^o) } ) .  Note  that  if 
the  probability  of  success  at  a  step  has  a  positive  lower  bound, 
the  random  variable  k(m)-k(m-1)  has  a  geometric  tail 
distribution,  and  E[k(m)-k(m-1 ) ]  is  finite.  Moreover,  the 
"drifts"  yk(m)“yk(m-1 )  are  independent.  By  a  renewal  argument, 
we  can  show 

E(yk(m+1)-yk(m))s  4*  E(k(m+1)-k(m)) 


where  A*  is  the  throughput  of  the  algorithm.  This  follows 
since  the  throughput  is  the  expected  number  of  message 
generations  in  y^m+l ) _yk(m)  divided  by  the  expected  number  of 
trials  E(k(m+1 )-k(m) ) .  This  holds  for  both  the  unconstrained 
case,  where  A *=.4877,  and  the  constrained  case. 

Now,  the  expected  difference  in  the  lag  at  times  yj{(in+-j)  and 
yk(m)  is 

E[k(m+1  )-k(m) ]  -  E[yk(m+1  }-yk(m)  ]  =  (  1-  >/X  )Etk(m+1  )-k(m)] . 

Hence,  in  the  idealized  version,  as  long  as  the 

expected  changes  in  lag  are  negative,  and  the  algorithm  will 

repeatedly  select  transmission  intervals  [y„»y  +F  )  where 

y„+Fr,>n. 
n  n 

When  {2}  holds,  it  is  easy  to  see  that  A *=min(  \  , .4877) . 
Clearly  A*^A*  If  X*<A,  then  the  expected  change  in  lag  from 
yk(m)  t0  yk(m+1)  is  Posifcive  and  the  lag  increases  without  bound 
as  n  goes  to  infinity.  But  whenever  the  lag  is  greater  than  or 
equal  to  =F(oe,oo),  the  choice  of  Fn  is  the  same  as  for  the 
unconstrained  algorithm,  and  the  throughput  is  .4877.  Hence, 
when  A  >•‘*877,  and  the  lag  goes  to  infinity. 

When  A^.4877,  A*  =  A  »  and  the  expected  change  in  lag  is  0. 
Furthermore,  from  the  above  observations  (i.e.,  the  facts  that 


k(m)-k(m-1)  has  a  geometric  tail  distribution  and  the  expected 
change  in  lag  is  negative  given  that  the  lag  exceeds  "C)  and  the 
results  in  Hajek  [16],  we  can  show  that  the  probability  that  the 
lag  is  greater  than  x  has  an  upper  bound  exponentially  decreasing 
with  x. 


It  is  reassuring  to  note  that,  even  when  the  generation  rate 
of  the  messages  exceeds  the  throughput  of  the  algorithm,  it  will 
continue  to  transmit  successfully  at  its  maximum  throughput. 

V.  The  General  FCFS  Algorithm 

We  note  that  the  algorithm  is  first-come  first-served 
(FCFS),  although  it  is  not  the  most  general  FCFS  algorithm.  The 
results  of  the  Section  III  suggest  some  conjectures  with  regard 
to  the  most  general  FCFS  algorithm,  which  we  describe  in  this 
section. 

For  an  algorithm  to  be  FCFS,  it  must  satisfy  one  of  two 
conditions.  Either  it  does  not  allow  a  message  to  be  transmitted 
when  other  messages  with  earlier  generation  times  must  wait,  or 
if  it  does,  the  probability  of  successful  transmission  must  be 
zero. 


Suppose  that  we  are  using  a  FCFS  algorithm  to  resolve 
conflicts  and  that  all  messages  with  generation  times  prior  to  yn 
have  been  successfully  transmitted.  We  will  call  the  set  of 
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messages  generated  after  yn  the  "queue" .  The  algorithm  selects 
some  subset  of  the  queue  to  transmit  in  the  next  slot,  which  we 
call  the  transmission  set.  Then  the  most  general  form  of  a 
transmission  set  which  satisfies  the  first  condition  will  clearly 
be  the  set  of  all  messages  generated  in  an  interval  of  the  form 

[  WrnJ- 

Now  let  us  consider  transmission  sets  satisfying  the  second 

condition.  Suppose  we  have  a  subset  of  the  queue,  S1 ,  which  is 

known  to  contain  at  least  one  message,  but  it  is  not  known 

whether  it  contains  more.  Consider  the  transmission  set  which  is 

the  union  of  S-j  and  some  subset  of  the  queue,  S2.  If  the  subset 

of  S2  which  is  disjoint  from  S1  is  not  empty,  then  a  conflict 

occurs  and  the  second  condition  holds.  If  the  subset  of  S2  which 

is  disjoint  from  is  empty,  then  must  be  the  set  of  messages 

generated  in  an  interval  of  the  form  fyn»yn+Fn^  for  the  first 

condition  to  hold.  Assume  that  the  algorithm  never  chooses  a 

transmission  set  that  is  known  to  contain  a  conflict,  we  cannot 

know  in  advance  if  the  subset  of  S2  disjoint  from  S1  is 

non-empty.  Hence,  must  be  the  set  of  messages  generated  in  an 

interval  of  the  form  [y„,y„+F„]  to  insure  that  one  of  the  two 

nwn  n 

conditions  hold. 

J 

The  general  FCFS  algorithm  must  use  transmission  sets 
satisfying  one  of  the  two  conditions  described  above.  It  differs 
from  the  basic  algorithm  of  section  II  only  by  permitting  the  use 
of  transmission  sets  satisfying  the  second  condition.  But  when 


we  consider  that,  for  our  algorithm  the  optimal  Fn(s,°o)  is  s; 

that  is,  when  an  interval  [yn,yn+Fn)  is  known  to  contain  at  least 

one  generation  time,  the  optimal  transmission  interval  is  just 

*-yn’yn+Fn^  *  seems  unlikely  that  using  a  more  general 

transmission  set  of  the  form  Cy,„,y„+F  )  U  S0  would  offer  any 

■'n’-'n  n  d 

improvement.  We  cannot  prove  this  conjecture,  however  since 
allowing  this  type  of  transmission  set  makes  it  no  longer 
possible  to  characterize  the  algorithm  as  a  Markov  process  with 
just  two  (or  even  a  finite  number  of)  state  variables. 

While  the  algorithm  described  in  section  II  is  not  the  most 
general  FCFS,  it  is  the  most  general  algorithm  having  the 
property  that  sources  attempt  to  transmit  messages  in  the  order 
that  they  were  generated. 

VI.  Unequal  Observation  Times 

In  fact  many  multiaccess  communication  systems  differ  from 
the  model  introduced  in  section  I  in  that  the  times  necessary  to 
learn  the  transmission  outcomes  depend  on  the  outcomes.  We 
denote  by  tQ,t^  and  t^  respectively  the  times  necessary  to  learn 
that  the  channel  was  idle,  or  that  a  success  or  a  collision 
occured. 

For  example  carrier  sense  radio  systems  [2]  can  detect  idles 
quickly  (no  carrier  present),  while  they  rely  on  error  detecting 
codes  and  the  transmissions  of  acknowledgements  to  distinguish 
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between  successes  and  collisions,  thus  tQ<<t.jst2.  In  addition, 
some  cable  broadcast  systems  [3]  have  a  listen-while-transmit 
feature  that  allows  the  quick  abortion  of  transmissions  resulting 
in  collisions,  thus  tQ=t2<<t.] . 


The  general  algorithm  outlined  in  section  II  and  the  remarks 
about  its  Markovian  nature  remain  valid,  but  the  reward  function 
r(-)  and  the  maximization  in  section  III  are  not  appropriate.  A 
better  measure  of  quality  is  to  minimize  the  expected  time  to 
send  a  message,  i.e., 


N  3 

lim  ^  t.  1(0  =j) 

N-V~  _ i _ _ _ 

N 

SLr(i) 
i  =  1 


=t1+t2 


lim 

N 


N  ^ 


K0i=o)  +  K0i=2) 


N 

r(i) 
i  =  1 


where  I(-)  denotes  the  indicator  function. 


The  limit  of  the  expected  value  in  the  right  hand  side  can 
be  interpreted  as  the  expected  time  overhead  per  message,  and 
depends  only  on  tQ/t2  for  a  given  F ( — , — ) .  It  will  be  denoted  by 
c  and  should  be  minimized  over  F(-,-)  for  a  given  tp/tg. 

The  optimization  of  the  general  algorithm  under  this 
formulation  for  a  large  number  of  values  of  tp/tg  is  time 


19  - 


consuming.  It  is  greatly  simplified  if  we  consider  only  those 
F(-,-)  such  that  F(s,t)ls.  The  only  recurrent  states  are  then  of 
the  form  (s,s),  or  (s,oo),  see  above.  Note  that  the  optimal  F 
found  in  Section  III  belonged  to  the  restricted  class.  We  will 
now  show  how  to  proceed  with  the  optimization. 

By  a  renewal  argument 
b  tn 

E(21  r  I  (0**0) +1(0  *  =  2) ) 

c=  _ 1=  1 _ 1  . 

b 

E(  2_ r( i ) ) 
i  =  1 

where  in  the  right  hand  side  one  assumes  that  ( s1  ,  t1 )  =  («*>  ,  °o)  and 
b  is  the  time  of  first  return  to  (o o,oo). 

Let  us  now  assume  that  we  guess  a  value  8  for  the  minimum  of 
c  over  all  restricted  F(-,-),  and  consider  the  function 
b  tn 

v(s,t)=  EC  2.  ~  I(01=O)+I(01=2)-8r(i) l(s. ft,)=(s,t>] 
i=1  l2  1  1 

Because  sn+^  is  either  equal  to  cO  or  is  less  than  sn, 
V(sfs)  and  V(s,°®)  can  be  written  as  convex  combinations  of 
V(s',s')  and  V(s',o®),  s,<min(s,F(°o,ao) ) .  It  is  straightforward 
[13]  to  minimize  V(s,s)  and  V(s,°°)  recursively  for  increasing  s, 
and  to  obtain  the  minimum  value  of  V(co, <=«). 

If  the  minimum  value  is  0,  8  was  guessed  correctly  and  is 
the  minimum  value  of  c.  If  the  minimum  value  of  V(oo,<»)  is 
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positive  (negative),  S  was  guessed  too  small  (large),  and  the 
minimization  of  V(-)  must  be  repeated  with  a  new  fi. 

The  resulting  minimum  value  of  c  is  shown  in  Figure  4,  as  a 
function  of  tg/t2.  It  is  almost  equal  to  the  expected  time 
overhead  per  message  for  the  binary  splitting  algorithm,  with 
only  F(tJ0,-xj)  is  optimized. 

VII.  Noisy  Feedback 

The  previous  algorithm  assumed  that  the  transmission 

outcomes  were  perfectly  observed  by  all  sources.  This  assumption 

is  critical.  One  verifies  easily  that  if  an  idle  at  time  n  is 

falsely  observed  as  a  collision  then  the  algorithm  will  deadlock. 

The  algorithm  will  behave  as  if  there  is  a  conflict  in  the 

interval  ^yn,yn+tn^  and  when  the  next  transmission  interval 

[yn,yn+Fn)  produces  an  idle,  the  algorithm  will  proceed  as  if 

there  was  a  conflict  in  the  interval  t y„+F„ , y„+t„ ) .  Hence,  y„+t 

n  n  ’ '  n  n  ’  n  n 

will  remain  constant  while  tR  goes  to  zero. 

D.  Ryter  [17]  has  recently  examined  the  problem  of  noisy 
feedback,  where  the  noise  can  cause  idles  or  successes  to  be 
observed  as  collisions.  He  showed  that  the  binary  splitting 
algorithm  [10]  outlined  in  section  II  can  be  modified  to  work 
properly.  The  essential  modification  is  the  introduction  of  a 
threshold  value.  If  tn  is  smaller  than  the  threshold,  then  the 
algorithm  becomes  non-stationary ,  in  the  sense  that  it  alternates 
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between  using  F(s,s)=s  and  F(s,s)=s/2,  thus  first  seeking 
confirmation  that  a  collision  really  occured,  then  trying  to 
resolve  it.  The  analysis  and  optimization  are  too  long  to  be 
reported  here.  The  main  result  is  that  with  the  proper  choice  of 
parameters,  the  throughput  behaves  roughly  like  ,487-p,  where  p 
is  the  probability  of  false  collision  indication. 

VIII.  Final  Comments 

The  main  results  of  this  paper  are  the  description  and 
analsyis  of  an  access  algorithm  for  the  channel  model  described 
in  Section  I,  with  infinitely  many  sources.  Its  throughput  is 
.4877,  the  largest  known  to  this  day.  Much  research  has  been 
done  to  determine  upper  bounds  on  the  possible  throughput  [183, 
[19],  [20],  [21].  Tsybakov  and  Mikhailov  [22]  have  recently 
shown  that  no  algorithm  can  have  a  throughput  higher  than  0.5874, 
and  it  is  widely  believed  that  the  best  achievable  throughput  is 
in  the  neighborhood  of  .5.  However,  throughputs  arbitrarily 
close  to  i  are  possible,  at  the  expense  of  high  average  message 
delay,  when  the  number  of  sources  is  finite. 

We  have  also  shown  how  the  algorithm  can  be  modified  in  the 
cases  of  variable  transmission  times  and  noisy  feedback.  Upper 
bounds  on  the  throughput  for  the  case  of  variable  transmission 
times  are  given  by  Humblet  in  [23], 

Finally,  it  should  be  pointed  out  that  although  the 
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algorithm  presented  here  uses  the  message  generation  times  to 
specify  when  they  should  be  transmitted,  this  is  not  necessary. 
Another  algorithm  can  be  described,  with  the  same  throughput  and 
expected  time  overhead  per  message,  where  sources  generate  random 
numbers  to  determine  if  they  should  transmit.  Of  course,  real 
time  properties,  like  first-generated  first-transmitted  will  not 
be  conserved. 


Appendix 


if  N(Tn)=0 
if  N(Tn)=1 
if  N(Tn)>2 


Define :  »n=[0,yn>,  Bn=[  y„,  y„«n ) ,  Cn.[yn,yn+tB),  Dn=tyr,*tn/=o) 

and  Tn  =  ^ yn' yn+Fn ^  *  Let  ^(S)  be  tbe  number  of  generation  times  in 
a  set  S.  Let 

0  =  f  0 

n 

I  1 

.  2 

Let  n)  =  (^f.  .  «>^n)  and  for  convenience  define  6(0)=$(-1  )  =  &, 
the  set  of  all  sample  processes.  (This  is  done  so  that  we  may 
condition  on  the  events  $(0)  and  0(-1).)  If  we  have  an  n-vector 
of  sets  _3=(S.j,.  .  •ySn),  for  any  set  A,  let  kf\  2  denote  the 
n-vector  (A/lS^.  .  .,AASn)  and  let  H(£)  denote 
( N( S1 ) , .  .  .,N(Sn)).  Then: 


Theorem:  For  any  integers  N^,  Nc,  Np,  choose  measurable  finite 

subsets  A  CZ-A  for  i=1,.  .  N  C/  C  for  J  =  1 , .  .  Nr, 
i  nj  N.  N„  L 

Dn  Dn  f°r  k  =  1f.  .  Np.  Then  for  any  vectors  m£Z  ,  £«Z  , 

k 


»D 

H^z  , 


Pr(lUn)=m,lI(£n)=jj,lI(J2n)=ii!^(n-1)) 

=  Pr(H(An)=m!0(n-1))Pr(H(£n)=p!N(Bn)i1,N(Cn)22) 
Pr(H(Jin)=fl)  {1} 


for  all  n=0, 1 , .  .  .  . 

Proof  :  For  n=0 ,  AQ=  fi  ,  Bn=Cn=[0  and  Dn=^  ,  and  so  {1}  is 


trivially  true. 


Now  we  proceed  by  induction.  Suppose  that  {1}  holds  for  n. 
We  will  show  that  {1}  holds  for  n+1 .  For  any  NA,  Nc,  Np  ,  we 
choose  finite  measurable  subsets  A^n  +  .jj  CAn  +  i  for  i  =  1».  •  .,NA, 

C(n  +  1 )  pCn+1  for  J  =  1»*  •  *»NC'  D(n  +  1  ),f:Dn  +  l  for  k  =  1  »  •  •  *»nd* 

J  r  K 

Note  that  since  o’  is  a  function  of  N(T  )  and  T /C  ,  {1}  implies 

n  n  n  n 

that  Pr(£  i^Cn-1 ) ) =Pr( 6  |N(B  )21,N(C  )22).  Hence, 
n  n  n  n 

Pr(H(An+1)=m,H(£n+1)=ii,Jl(fin+1)sa!6*(n)) 

=Pr(fl(An+1 )  n+1 )  =pfH(Bn+1 )  =u,6n  !(?( n-1 ) ) 

/Pr(6n|b(n-1)) 

=  Pr(N(An  +  1)=in,^(£n+1)=p,N(£n+1  )=r,^n  i«n-1) ) 

/Pr(6n!N(Bn)21,N(Cn)22)  {A.1} 

Now  since  f  A  VJC  ,C  X  c  UD  and  D  -t'C  u’D  ,  and  because  A  ,  , 
n  +  l  n  n  n  +  l  n  n  n+1  n  n  n+l 

Cn+1  and  Dn+i  are  disjoint,  {A.1}  is  equal  to 
^|LPr^(^  +  1AAn)=ffl^<^n  +  10cn)=m-^ 

K(Cn+^Cn)=q,]i(En  +  1/>Dn)=ii-e},6n!6'(n-1)) 

/ Pr( |N(Bn>21 ,N(Cn)12) 

=  Ta  ^Pr(N(An+1OAn)=tfli6*(n-1))Pr(I(An+10cn)=in-ft, 

n(cn+incn)=p,u(iin+incn)=q,{rniN(Bn)2i,N(cn)22) 

■Pr(i{(Cn+1/)Dn)=£-p,2{(I2n+1^Dn)=ia-g) 

/Pr(£nJN(Bn)21,N(Cn)22) 

=  >.  >  V.  Pr((li(An  +  1('Un)=ffli6‘(n-1))Pr(N(Cn+ir>Dn)=p-p 
•Pr(HCJ2n+1nDn)=n-Q)Pr(ll(An+1ACn)affl-«, 
H(£n+inCn)=p,i{(Cn+1ACn)^,^n,N(Bn)21,N(Cn)22) 
/Pr(^n,N(Bn)21,N(Cn)22)  {A. 2} 
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where  the  second  step  follows  by  the  induction  hypothesis,  and 
the  last  step  follows  by  elementary  probability  theory  and  the 
fact  that  for  a  Poisson  process,  arrivals  in  disjoint  sets  are 


independent.  Now  we  evaluate  equation  {A. 2}  for  two  cases:  one 

where  CT  =0  or  1  and  one  where  <■  =2. 
n  n 

If  or  1,  {A. 2}  is  equal  to: 

Pr(N(A  ./lA  )=(fl  |6(n-1 )  )Pr(U(C  >=*-p) 

p  g  n+l  n  n+1  n 

*Pr(N(Dn  +  inDn)=fl-Q)Pr(N(An+1OCn)=in-ffi,JS(£n+inCn)=p, 

a(fin.inc„>=«'£-n-"<VTn>i1-Cn'N<CnVTn,i2-(':n) 

/pr<C-n,N(Bn\Tn)21-f„,N(C„\I„)i2-C'n) 

=||  v  Pr(N(An+1AAn)=(fl,^  (n-1))Pr(I(£n+inDn)=p-p) 

•Pr(N(Dn+lnDn)=a-Q)Pr(M(An+iriCn)=iD-ffi/}n) 

•Pr(U(£„1AC„)=P,N(B„\T„)i1-«n>»(C11\Tn)22-#n) 

*Pr(N(Dn+10Cn)=(3)/[Pr(f  (n-1))Pr(t:n)Pr(N(Bn\Tn)21-^n, 

N(Cn\Tn)22-^'n)]  {A. 3} 


Here  we  have 

made  use  of 

the  facts  that  for  6  =0  or 

n 

1, 

TnCAn.1  ’ 

B  \TCC  .  , 
n  n  n+l  * 

VTnCCn  +  1’ 

and,  since  Ar+1 ,  Bn+1 

and 

cn+1  are 

disjoint,  we 

may  use  the 

Poisson  assumption  to 

decouple  the 

probabilities 

i  as  above. 

Now  if  0--O,  B  \T  sB  ,  and  C  \T  =<:  ,  .  It  is  always  true 

n  n  n  n+l  n  n  n+l 

that  N(Bn\Tn)20.  Also,  if  C:n=1,  cn\Tn=Bn+1,  and  since 
Cn+1 =  ^ yn+1 '  '  N(Cn+^)22  holds  with  probability  one.  So  the 

event  {N(Bn\Tn)21-^n,  N(Cn\Tn)22-/-n)  is  equal  to  {N(Bn+1)21, 


N(Cn+1)22}.  Hence  {A. 3)  equals 

^-2.^_PrdL(An+1/>An)=tfl,H(An+1^Cn)=ni-Aifr(n)) 

■W!(S|,^C„)=(U(l!llt1Mn)=HI 
=Pr(Ji(An  ,.,)=«  It  (n))Pr(U(£ntl)=j!m(Bntl)i1,N(Cn^1)i2) 
•Pr(H(Jin+,)=fl) 

which  is  the  desired  result. 

If  6  n=2 ,  the  event  {(r  ,  N(B  )il,  N(Cn)22}  is  equal  to 
{N(Bn)>1,  N(Tn)>2},  since  Tn<^Cn.  If  Fn^sn,  then  TnC.Bn  and 

Bn+1=Cn+1=Tn>  so  this  event  is  e(*ual  t0  {N(Tn)22}  or  {N(Bn+1)A1, 
N(Cn+1)>2}.  If  Fn>sn,  Bn+1=Bn,  Cn+1=Tn,  and  this  event  is  still 
equal  to  {N(Bn+1)A1,  N(  Cn  +  1  )J>2} .  Hence,  {A. 2}  is  equal  to: 
PrOl(An+1nAn)=ifli6(n-1))Pr(JJ(£n+inDn)=fi-p) 

•Pr(N(Dn  +  1ODn)=fl-q)Pr(liCAn+1ACn)=m-ft) 

•pr(N(Cn+inCn)=P,N(Bn+1)21,N(Cn+1)22) 

•Pr(H(J2n+incn)sq)/Pr(N(Bn+1)21,N(Cn+1)12) 

=2:*  £  Pr(li(A„  ,  iHA  ) =ft , fr(n~1 ) )  Pr (IK . « AC  )  =m-ft)Pr(£v ) 
ft  P  ^  n+i  n  n+i  n  n 

F  S  /Pr(f(n-1))Pr(tn) 

■pr(|(y\)^W(W'Cn):^«(Bn+^M(cntl)22) 

/Pr(N(Bn+1)21,N(Cn+1)22) 

•Pr(N(pn+1ncn)=q,N(£n+1nDn)=a-Q) 

=  PrU(An+1)=<M(n))PrU(£n  +  1)=piN(Bn+1)21,N(Cn+1)22) 
Pr(H(fin+1)=fl). 

The  last  steps  here  follow  by  noting  that  the  appropriate  groups 
of  subsets  are  disjoint  and  applying  the  Poisson  assumption. 


Hence  we  have  shown  that  (*)  holds  for  n+1 . 


Q.E.D. 


V(.o<>,F) 
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